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INTERNATIONAL PRELIMINARY EXAMINATION REPORT 



International application No. 

PCT/FR99/01736 



I. Basis of the report 



1 . This report has been drawn on the basis of {Replacement sheets which have been furnished to the receiving Office in response to an invitation 
under Article 1 4 are referred to in this report as 'originally filed " and are not annexed to the report since ihey do not contain amendments X 

[ I the international application as originally filed. 

the description, pages ^'8 , as originally filed. 



the claims, 



pages 
pages 
pages 

Nos. 
Nos. 
Nos. 
Nos. 
Nos. 



1-16 



the drawings. 



sheets/fig 
sheets/fig 
sheets/fig 
sheets/fig 



1/1 



filed with the demand, 
filed with the letter of 
filed with the letter of 



as originally filed. 

as amended under Article 19, 

filed with the demand, 

filed with the letter of 

filed with the letter of 



as originally filed, 
filed with the demand, 
filed with the letter of 
filed with the letter of 



2. The amendments have resulted in the cancellation of: 

I I the description, pages 

I I the claims, Nos. 

I I the drawings, sheets/fig 



2 I I This report has been established as if (some of) the amendments had not been made, since they have been considered 
— to go beyond the disclosure as filed, as indicated in the Supplemental Box (Rule 70.2(c)). 



4. Additional observations, if necessary: 
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International application No. 


INTERNATIONAL PRELIMINARY EXAMINATION REPORT 




PCT/FR 99/01736 


V. Reasoned statement under Article 35(2) with regard to novelty, inventive step or industrial applicability; 
citations and explanations supporting such statement 


1 . Statement 






Novelty (N) Claims 


1-16 YES 


Claims 




NO 


Inventive step (IS) Claims 


1-16 YES 


Claims 




NO 


Industrial apolicabilitv (lA) Claims 


1-16 YES 


Claims 




NO 



2. Citations and explanations 

The application relates to a device and a method for 
timing the processing of data detected in a data stream. 
In particular, this device and method can be used for data 
streams conveyed according to the MPEG 2 transport 
standard. 

The closest prior art cited in the international search 
report is document EP-A-765 082 (Sony) . This document 
describes more particularly a method and a device for a 
multitude of sub-title signals. The decoding system 
receives a multiplex of data stored in a register. Access 
to the register is controlled by means of a list 
stipulating the order in which the subtitles appear on the 
screen and the address of the corresponding data in the 
register. Moreover, managing the extraction of data 
requires concatenation by pointers in order to structure 
the succession of sub-title data. 



The application describes and claims a method and a device 
according to which a minimum data processing time, 
proportional to the amount of data in the data stream, is 
determined . 

Since this feature is not known from the above-cited prior 
art, the subject matter of the independent claims is novel 
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INTERNATIONAL PRELIMINARY EXAMINATION REPORT 



International application No. 
PCT/FR 99/01736 



(PCT Article 33(2)). Said feature solves the problem of 
an uncontrollable processing time of the data in the 
successive data packets which require different processing 
times. Setting a minimum data processing time enables 
said data processing to be organized such that the data 
can indeed be evaluated. This problem is not addressed in 
the prior art, nor is the solution defined in the 
independent claims obvious therefrom. The subject matter 
of said claims therefore involves an inventive step (PCT 
Article 33 (3) ) . 

The claims dependent on the independent claims define 
preferred embodiments of the invention that are neither 
described nor suggested by the documents cited in the 
search report. 
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RAPPORT DE RECHERCHE INTERNATIONALE 



nde Internationale No 



T/FR 99/01736 



A. CLASSEMENTOE L'OBJETDE LA DEMANDE 

CIB 7 H04N7/52 H04N5/278 



Selon la classification intemationale des brevets (CIB) ou ^ la fois selon la classification nationale at la CIB 



B. DOMAINES SUR LESQUELS LA RECHERCHE A PORTE 



Documentation mini male consult6e (systems de classification suivt des symboles de classement) 

CIB 7 H04N 



Documentation consulted autre que ta documentation minimale dans la mesure oil ces documents reinvent des domaines sur lesquels a portd la recherche 



Base de donndes ^lectronique consult^e au cours de ta recherche Internationale (nom de la base de donn^es. et si realisable, termes de recherche utilises) 



C. DOCUMENTS CONSIDERES COMME PERTINENTS 



Cat6gorie * Iderrtification des documents cMs, avec, le cas 6ch6ant. Ilndication des passages pertinents 



no. des revendications visdes 



EP 0 765 082 A (SONY CORP) 

26 mars 1997 (1997-03-26) 

colonne 7, ligne 30 -colonne 8, ligne 28 



1-15 



j I Voir la suite du cadre C pour la fin de la liste des 



documents 



Les documents de families de brevets sont indiquds en annexe 



Categories spdctates de documents cites: 

"A" document d6finissant rdtat general de ta technique, non 

considere com me part leu lie re ment pertinent 
"E" document anterieur, mais pubtie & la date de depdt International 

ou apres cette date 

"L" document pouvant jeter un doute sur une revendication de 
priorite ou cite pour determiner la date de publication d'une 
autre citation ou pour une raison speciale (telle qu'indiquee) 

"O" document se referent k une divulgation orale, h un usage, k 
une exposition ou tous autres moyens 

°P" document publie avant ta date de depdt international, mars 
posterieurement k la date de priorite revendiquee 



T" document ulterleur publie aprds ta date de depdt international ou la 
date de priorite et n'appartenenant pas k retat de la 
technique pertinent, mais cite pour comprendre te principe 
ou la theorie constituant la base de ('invention 

"X" document particuli6rement pertinent; rinven tion revendiquee ne peut 
etre consideree comme nouvelte ou comma impliquant une actrvite 
inventive parrap|:x>rt au document considere isoiement 

"Y" document particuli6rement pertinent; finven tlon revendiquee 

ne peut dtre consideree comme impliquant une activite inventive 
lorsque le document est assocte h un ou plusieurs autres 
documents de meme nature, cette combinaison etant evidente 
pour une personne du metier 

document qui fait partie de la mdme famine de brevets 



Date k laquelle la recherche Internationale a ete effectivement achevee 



15 septembre 1999 



Date d'expedition du present rapport de recherche intemationale 



21/09/1999 



Nom et adresse postale de I'administration chargee de la recherche intemationale 
Office Europe en des Brevets, P. B. 5818 Patentlaan 2 
NL - 2280 HV Rijswljk 
Tel. (+31-70) 340-2040, Tx. 31 651 epo nl. 
Fax: (+31-70) 340-^016 



FofKStionnaire autortse 



Raeymaekers, P 



Formutalre PCT/ISA/21 0 (deuxtdme teuUle) (JuiDet 1992) 
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RAPPORT DE RECHERCHE INTERNATIONALE 

Renseignements relatifs aux^^^^esde families de brevets 



Br 
T 



mde Internationale No 

VFR 99/01736 



Document brevet cite 
au rapport de recherche 



Date de 
publication 



Membre(s) de la 
famine de brevet(s) 



Date de 
publication 



EP 0765082 



26-03-1997 



JP 
US 



9154063 A 
5847770 A 



10-06-1997 
08-12-1998 



Fofmulaire PCT/ISA/21 0 (annexe famiPes de brevets) (juiJlet 1 992) 
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TRAITE (^COOPERATION EN MATIE^I^ 

PCT ^ 

RAPPORT D'EXAMEN PRELIMINAIRE INTERNATIONAL 

(article 36 et regie 70 du PCT) 



Rdfdrence du dossier du ddposant ou du 
mandataire 

PF980045 


voir la notification de transnnission du rapport d'examen 
POUR SUITE A DONNER pr6liminaire international (formulaire PCT/IPEA/416) 


Demande rntemattonale n** 
PCT/FR99/01736 


Data du ddpot international Qour/mois/annSB) 
16/07/1999 


Date de priorite (jour/mois/ann^B) 
17/07/1998 



Classification Internationale des brevets (CIB) ou k la fois classification nationale et CIB 
H04N7/52 



D^posant 

THOMSON MUL TIMEDIA et al. 

1 . Le present rapport d'examen preliminaire international, etabll par I'adnrtinistaration chargee de I'examen preliminaire 
international, est transmis au deposant conformement a rarticle 36. 



2. Ce RAPPORT comprend 4 feullles, y compris la presente feuille de couverture. 

□ II est accompagne d'ANNEXES, c'est-a-dire de feullles de la description, des revendications ou des dessins qui ont 
ete modiflees et qui servent de base au present rapport ou de feullles contenant des rectifications faites aupr^s de 
I'administratlon chargee de I'examen preliminaire international (voir la regie 70.16 et I'instruction 607 des Instructions 
administratives du PCT). 

Ces annexes comprennent feuitles. 



3. Le present rapport contient des indications relatives aux points suivants: 



1 




Base du rapport 


It 


□ 


Priorite 


III 


□ 


Absence de formulation d'opinion quant a la nouveaute, I'activite Inventive et la posslbilite 
d'application industrielle 


IV 


□ 


Absence d'unite de Tinvention 


V 




Declaration motivee selon Tarticle 35(2) quant a la nouveaute. I'activite inventive et la possibility 
d'application industrielle; citations et explications a I'appui de cette declaration 


VI 


□ 


Certains documents cites 


VII 


□ 


Irr^gularites dans la demande Internationale 


VIII 


□ 


Observations relatives k la demande Internationale 





Date de presentation de la demande d'examen preliminaire 
Internationale 

03/02/2000 


Date d'achdvement du present rapport 
20.04.2000 


Nom et adresse postale de radministration chargee de 
I'examen preliminaire intemational: 

^ Office europeen des brevets 
^ D-80298 Munich 

T6I. +49 89 2399 - 0 Tx: 523656 epmu d 
Fax: 449 89 2399 - 4465 


Fonctionnaire autorise ^^^^jS^S^j;^^ 

D/L FUENTE DEL P C ^ |) 
N*' de telephone +49 89 2399 8608 



Formulaire PCT/I PEA/409 (feullle de couverture) (janvier 1994) 
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RAPPORT D'EXAMEN 
PRELIMINAIRE INTERNATIONAL 



Demande intemationale n** PCT/FR99/01 736 



i. Base du rapport 

1 . Ce rapport a et^ redig6 sur la base des elements ci-apr^s {!es feuilles de remplacement qui ont 6te remises ^ 
I'office recepteur en r4ponse a une invitation faite conformement a l*article 14 sont considerees, dans le present 
rapport, comme "initialement deposdes" et ne sont pas jointes en annexe au rapport puisqu'elles ne contiennent 
pas de modifications.) : 

Descrsptscn, pages: 

1-8 version initiale 

Revendications, N*": 

1-16 version initiale 

Desslns, feuilles: 

1/1 version initiale 



2. Les nnodifications ont entraine I'annulation : 

□ de la description, pages : 

□ des revendications. n*** : 

□ des dessins, feuilles : 

3. □ Le present rapport a ete formule abstraction faite (de certaines) des modifications, qui ont 4t6 considerees 

comme allant au-del^ de i'expos^ de {'invention tel qu'il a ete depose, comme il est indique ci-apres 
(regie 70.2(c)) : 

4. Observations complementaires, le cas ^cheant : 
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RAPPORT D'EXAMEN 
PRELIMINAIRE INTERNATIONAL 



Demande intemationale n* PCT/FR99/01 736 



V. Declaration motivee selon I'article 35(2) quant a la nouveaute, I'activite inventive et la possibitite 
d'application industrieile; citations et explications a I'appui de cette declaration 

1. Declaration 

Nouveaut^ Oui : Revendications 1-16 

Non : Revendications 

Activite inventive Oui: Revendications 1-16 

Non : Revendications 

Possibilite d'application industrieile Oui : Revendications 1-16 

Non : Revendications 



2. Citations et explications 
voir feuille separee 
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RAPPORT D'EXAMEN Demande intemationale PCT/FR99/01 736 
PRELIMINAIRE INTERNATIONAL - FEUILLE SEPAREE 



Ad section V: 

La demande concerne un dispositif et un precede pour gerer temporellement 
I'exploitation de donnees detectees dans un flux de donnees. En particulier ces 
dispositif et methode trouvent une exploitation dans des flux de donnees vehiculee 
selon la norme de transport MPEG2. 

L'art anterieur la plus proche cite dans le rapport de recherche Internationale est le 
document EP-A-765 082 (Sony). Ce document decrit plus particulierement une 
methode et un appareil pour une multitude de signaux de sous-titrage. La systeme de 
decodage regoit un multiplex de donnee qui sont stockees dans un registre. L'acces au 
registre est commande au moyen d' une liste stipulant I'ordre d'apparition des sous- 
titres a Tecran ainsi que Tadresse des donnees correspondantes dans le registre. En 
outre la gestion de Textraction des donnees fait appel a une chainage par pointeurs 
pour structurer la succession des donnees relatives au sous-titres. 

La demande decrit et revendique une methode et un dispositif selon lesquels on 
determine une duree minimale s'exploitation des donnees proportionnelle a la quantite 
de donnees contenues dans le flux de donnees. 

Cette caracteristique n'est pas connue de I'art anterieur sus-cite, Tobjet des 
revendications independantes est done nouveau (Article 33(2) PCT). Cette 
caracteristique resout le probleme d'une duree d'exploitation non-controlable des 
donnees contenues dans des paquets de donnees successifs requerant des durees 
d'exploitation differentes. L'imposition d'une duree minimale d'exploitation minimale de 
ces donnees permet une organisation de Texploitation de ces donnees de sorte que 
ces donnees puissent effectivement etre evaluees. Ce probleme n'est pas aborde dans 
I'art anterieur, la solution definie dans les revendications independantes ne sauraient 
decouler de fagon evidente de Tart anterieur. L'objet de ces revendication implique 
done une activite inventive (Article 33(3) PCT) 

documents 

Les revendications dependantes des revendications independantes definissent des 
formes preferentielles de realisation de invention qui ne sont ni decrites ni suggerees 
par les documents cites dans le rapport de recherche. 



Fomnulairo PCT/Feuille s6parde/409 (feuille 1) (OEB-avril 1997) 
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(21) Num^ro de la demande internationale: PCT/FR99/0 1 736 
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(72) Inventeur; et 

(75) Inventeur/Deposant (US seulement)'- MACE, Philippe 
[FR/FR]; Thomson Multimedia, 46, quai Alphonse Le 
Gallo, F-92100 Boulogne Billancourt (FR). 

(74) Mandataire: RUELLAN LEMONNIER, Brigitte; Thomson 
Multimedia, 46, quai Alphonse Le Gallo, F-92100 Boulogne 
Billancourt (FR). 



(81) Etats design^s: CN, ID, IN, JP, KR, MX, US, ZA, brevet 
europ6en (AT, BE, CH, CY, DE, DK, ES, FI, FR, GB, OR, 
IE, IT, LU, MC, NL, PT, SE). 



Publiee 



Avec rapport de recherche internationale. 



(54) Title: METHOD FOR TIMING DATA PROCESSING AND IMPLEMENTING DEVICE 

(54)Titre: PROCEDE POUR GERER . TEMPORELLEMENT L' EXPLOITATION DE DONNEES ET DISPOSITIF METTANT EN 
OEUVRE LE PROCEDE 




'Y 



BV1 



BV2 



BVn 



•CNT 



(57) Abstract 

The invention concerns a method and a de- 
vice for timing the processing of data detected in 
a data flow and constituting a data set. The de- 
vice comprises a circuit (MP) for computing a 
minimal duration of the data processing propor- 
tional to the quantity (L) of data contained in the 
data set. The invention is particularly useful in 
cases where the data are digital data representing 
sub-headings detected in a data flow conveyed 
according to MPEG 2 System transport standard. 
Thus the data processing corresponds to the dis- 
play of the sub-headings. 

(57) Abr^gd 

LMnvention conceme un proc6d6 et un dis- 
positif pour g€rer temporellement Texploitation 
de donntes d^tect6es dans un flux de donndes 
et constituant un ensemble de donndes. Lc dis- 
positif comprend un circuit (MP) pour calculer 
une duree mini male d 'exploitation des donnees 
detect6es proportionnelle h. la quantity (L) de donnees contenues dans Tensemble des donn6es. L'invention s*applique plus particulidrement 
au cas oil les donn6es d6tect6es sont des donn6es num^riques repr6sentant des sous-titres ddtect^s dans un flux de donn6es v6hicuI6es selon 
la norme de transport MPEG 2 System. L' exploitation des donn6es correspond alors & I'affichage des sous-titres. 



MP 



BR 1 ,BR2.B R m,8V1 .BV2.BVn...ME MORV WORKSPACE 
ST^TRANSMmtD SIGNAL 
CKfT„.COLWTER 
UP-JuUCROPROCESSOR 
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PROCEDE POUR GERER TEMPORELLEMENT SEXPLOITATION DE 
DONNEES ET DISPOSITIF METTANT EN CEUVRE LE PROCEDE 

L'invention concerne un procede pour gerer temporellement 
rexploitation de donnees detectees dans un flux de donnees ainsi que le 
dispositif mettant en oeuvre le procede, 

(-'invention trouve une application particulierennent avantageuse pour 
5 gerer temporellement I'affichage de sous-titres obtenus a partir de donnees 
numeriques detectees dans un flux de donnees vehiculees notamment mais 
non exclusivement selon la norme de transport MPEG 2 System. 

Dans la plupart des cas, un flux de donnees vehiculees selon la 
norme de transport MPEG 2 System comprend un signal de reference 

10 temporelle communement note PGR (Kabreviation PGR provient de I'anglais 
" Programme Clock Reference Le signal de reference PGR permet d'etablir 
une echelle des temps pour les donnees contenues dans le flux. Par aiileurs, le 
flux de donnees contient egalement des signaux de synchronisation 
communement notes PTS (rabreviation PTS provient de I'anglais 

15 " Presentation Time Stamp Un signal de synchronisation PTS est un signal 
permettant de mettre en oeuvre une action sur certaines des donnees 
vehiculees par le flux. Pour les donnees correspondant a un sous-titre, 11 peut 
s'agir. par exemple, de Taction d'affichage du sous-titre en synchronisation 
avec Tapparition d'une image. Le signal PTS d'affichage associe a un sous-titre 

20 est vehicule dans I'en-tete du sous-titre. Sa valeur donne Tinstant auquel le 
sous-titre doit etre affiche. 

Les sous-titres sont generalement constitues de donnees codees. II 
est done necessaire de les decoder avant de les afficher. Par donnees codees 
il faut entendre, par exemple, des donnees compresser qu'il faut decompresser 

25 avant affichage. 

Au cas ou, par exemple, I'instant auquel un sous-titre doit etre 
affiche est tres proche de I'instant auquel ce sous-titre est detecte dans le flux, 
raffichage d un sous-titre peut presenter des inconvenients. Par " tres proche 
dans le temps '\ 11 faut entendre que la duree qui separe I'instant auquel le 

30 sous-titre est detecte est du meme ordre de grandeur ou inferieur a la duree 
necessaire au decodage des donnees qui representent le sous-titre. Dans ces 
conditions, la duree d'affichage du sous-titre peut etre tres courte et, a 
Textreme. le sous-titre peut etre perdu. 

35 Par aiileurs, dans d'autres cas, le flux de donnees vehiculees selon 

la norme MPEG 2 System ne contient pas de signal PTS d'affichage des sous- 
titres. Ces cas correspondent, par exemple, au sous-titrage simultane pour 
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lequel il est souhait^ que les sous-titres soient affiches d&s que possible apr^s 
avoir ete detectes et decodes. Dans ces cas. quand un sous*titre court succ^de 
a un sous-titre long, la duree d'affichage du sous-titre long peut etre inferieure a 
la duree d'affichage du sous-titre court. En effet, la duree possible d'affichage 
5 AST1 est alors egale a : 

AST1 = AT + DST2 - DST1 , ou : 

AT est I'intervalle de temps separant le premier sous-titre ST1 et le 
sous-titre ST2 qui succede au sous-titre ST1 , 

DST1 est la duree de decodage du sous-titre ST1, et 
10 DST2 est la duree de decodage du sous-titre ST2. 

Pour des sous-titres ST1 et ST2 respectivement long et court, les 
durees DST2 et DST1 sont respectivement courtes et longues. II s'ensuit que la 
duree d'affichage du sous-titre long ST1 est d'autant plus courte que le sous- 
titre ST2 est un sous-titre court et le sous-titre ST1 est un sous-titre long. 

15 

Uinvention ne presente pas ces inconvenients. 
En effet. invention concerne un dispositif pour gerer temporellement 
Texploitation de donnees detectees dans un flux de donnees et constituant au 
moins un ensemble de donnees. le dispositif comprenant un circuit de 

20 traitement des donnees detectees. une memoire de stockage des donnees 
detectees, les donnees en train d'etre traitees. les donnees traitees destinees a 
etre exploitees et les donnees traitees en cours d'exploitation, I'exploitation des 
donnees traitees devant etre declenchee a un instant theorique donne. Le 
dispositif comprend un circuit de calcul d'une duree minimale d d'exploitation 

25 des donnees proportionnelle a la quantite de donnees contenues dans 
Tensemble de donnees. 



L'invention concerne egalement un precede pour gerer 
temporellement Texploitation de donnees detectees dans un flux de donnees et 

30 constituant au moins un ensemble de donnees. le precede comprenant une 
etape de stockage des donnees detectees. une etape de traitement des 
donnees stockees. une etape de stockage des donnees issues de Tetape de 
traitement et une etape d'exploitation des donnees stockees issues de Tetape 
de traitement. Texploitation des donnees traitees devant etre declenchee a un 

35 instant theorique donne. Le precede comprend une 6tape de calcul d'une duree 
minimale d d'exploitation des donnees proportionnelle a la quantite de donnees 
contenues dans I'ensemble des donnees. 
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L'invention trouve une application particulierement avantageuse 
dans le cas ou Tensemble de donnees d6tectees dans le flux de donnees 
represents un sous-titre constitue de donnees codees. lequel sous-titre doit 
etre affiche sur ecran apres decodage des donnees. Le decodage des donnees 
5 constitue alors le traitement des donnees et raffichage des donnees constitue 
Texploitation des donnees. 

Ainsi, l'invention concerne egalement un dispositif tel que celui selon 
invention mentionne ci-dessus, caracterise en ce que Tensemble de donnees 
detectees represente un sous-titre constitue de donnees cod6es detectees 
10 dans un flux de donnees vehiculees selon la norme de transport MPEG 2 
System, non exclusivement, et en ce que le circuit de traitement est un circuit 
de decodage des donnees codees, Sexploitation des donnees etant Taffichage 
des donnees sur ecran. 

Uinvention concerne encore un decodeur fonctionnant selon une 
15 norme de compression du type MPEG 2 video, caracterise en ce qu'il 
comprend un dispositif tel que celui selon Tinvention mentionne ci-dessus. 

De meme, invention concerne un precede tel que celui selon 
mentionne ci-dessus. caracterise en ce que Tensemble de donnees detectees 
dans le flux de donnees represente un sous-titre constitue de donnees codees 
20 detectees dans un flux de donnees vehiculees selon la norme de transport 
MPEG 2 System, en ce que le traitement des donnees est le decodage des 
donnees codees et en ce que Texploitation des donnees est Taffichage des 
donnees sur ecran. 

Uobjet de Tinvention est de garantir une duree minimale d 
25 d'expioitation d'un ensemble de donnees proportionnelle a la quantite de 
donnees que contient cet ensemble. 

Une fois calculee, la duree minimale d est appliquee a un circuit de 
commande de la duree d'exploitation de fagon que la duree d'exploitation des 
donnees ne puisse etre inferieure a d. 

30 

Dans le cadre de I'application particuliere de l'invention a Taffichage 
de sous-titres, la duree minimale d*affichage du sous-titre peut etre donnee par 
la donnee D(ST) telle que : 

D(ST) = KsT x L, L etant la longueur du sous-titre et Kgy un nombre 

35 reel positif. 

La longueur L peut etre Tinformation de longueur du sous-titre que 
contient le fiux de donnees. La longueur L peut aussi etre egale au nombre de 



wo 00/04724 




PCT/FR99/01736 



4 



pleines lignes du sous-titre decode exprime sous la forme d'un nombre reel. 
D'autres donnees relatives au sous-titre peuvent egalement etre utilis6es pour 
calculer la donnee D(ST). II peut s'agir. par exemple. d'un parametre m 
dependant de la connplexite de la langue dans laquelle le sous-titre doit etre 
5 affiche. Dans ce cas, un ensemble de langues comprises dans une table non 
decrite sont associees a des coefficients de ponderations permettant de varier 
le parametre m en fonction de la langue. La donnee D(ST) s'ecrit alors : 
D(ST) = KsT X L X m. 

Ainsi, rinvention trouve une application particulierement interessante 
10 pour la diffusion d'un meme programme sur un territoire ou sont utilisees 
differentes langues. 



Selon un perfectionnement de rinvention, la duree minimale 
d'exploitation des donnees est rendue compatible de contraintes de 

15 synchronisation, de durees de traitement des donnees avant exploitation et de 
memoire vive a disposition pour stocker les donnees. 

La figure jointe represente un dispositif permettant la mise en oeuvre 
du perfectionnement de invention. A titre d*exemple non limitatif, ce 
perfectionnement est decrit dans le cadre de Tapplication particuliere de 

20 Taffichage de sous-titres. 

Le dispositif comprend deux zones memoires Z1 et 22, un compteur 
CNT et un microprocesseur MP. 

Les zones memoire Z1 et Z2 sont des zones de memoire vive de 
type RAM (rabreviation RAM provenant de I'anglais " Random Access 

25 Memory"). La zone memoire Z1 est divisee en plusieurs espaces memoire 
BR1, BR2..., BRm qui seront par la suite appeles buffers de reception. De 
meme, la zone memoire 22 est divisee en plusieurs espaces memoire BV1. 
BV2, ...Bvn qui seront par la suite appeles buffers de visualisation. Comme cela 
est connu de I'homme de Tart, un buffer de visualisation est un espace 

30 memoire capable de permettre I'affichage sur ecran des donnees qu'il contient. 

Les donnees qui representent les sous-titres constituent un signal 
ST transmis a la zone memoire Z1. Selon rinvention, les donnees qui 
representent un sous-titre sont stockees dans un premier buffer de reception 
BR1 . Si le traitement des donnees effectue dans la zone de memoire Z2 n'est 

35 pas termlne, alors les donnees qui representent le sous-titre suivant sont 
stockees dans un autre buffer de reception BR2. Les sous-titres stockes dans 
la zone memoire Z1 sont transmis a la zone memoire Z2 les uns apres les 
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autres de fa^on qu'un sous-titre transmis dans la zone 22 soit toujours le plus 
ancien stocke dans la zone Z1 . 

Selon le mode de realisation preferentiel de Tinvention, chaque 
buffer de la zone Z2 se trouve soit en etat de decodage des donnees qu1l 
5 contient, soit vide de toute donnees. soit en etat d'attente d'affichage, soit en 
etat d'affichage. Par buffer en " etat d'attente d'affichage 11 faut entendre que 
les donnees contenues dans le buffer sont destinees a etre lues pour affichage. 
Par buffer " en etat d'affichage il faut entendre que les donnees contenues 
dans le buffer sont en cours de lecture de fa?on a etre affichees sur ecran. 

10 Selon un autre mode de realisation de I'invention. le d6codage des 

donnees n'est pas effectue dans un buffer de visualisation de la zone 22 mais 
dans un buffer de reception de la zone Z1. 11 est alors possible que Toperation 
de decodage des donnees s'effectue au fur et a mesure de leur reception. 

De fagon preferentielle, la zone memoire 22 est divisee en 5 buffers 

15 de visualisation dont chacun est susceptible de se trouver soit en etat de 
decodage, soit vide de donnees, soit en etat d'attente d'affichage. soit en etat 
d'affichage. Selon le mode de realisation preferentiel de Tinvention, un buffer 
de visualisation se trouve en permanence en etat de decodage et un autre en 
etat d'affichage. II s'ensuit que les 3 autre buffers se trouvent soit vides de 

20 donnees. soit en etat d'attente d'affichage. De fagon generate, si n est le 
nombre de buffers que contient la zone 22, alors n-2 buffers sont soit vides de 
donnees. soit en attente d'affichage. 

A chaque fois qu'un buffer passe a I'etat d'attente d'affichage, un 
information I est transmise de la zone memoire 22 vers le microprocesseur MP. 

25 En retour. le microprocesseur MP transmet au compteur CNT une donnee D 
permettant d'incrementer ce dernier d'une unite. Le compteur transmet alors a 
la zone memoire 22 une donnee E permettant d'etiqueter le buffer qui vient de 
passer a I'etat d'attente d'affichage. Au moment de Taffichage, le buffer en etat 
d'affichage est alors identifie comme etant celui dont I'etiquette signale qu'il est 

30 le plus ancien. 



De fapon generate, la duree d d'affichage calculee par le 
microprocesseur MP a un instant t peut s'ecrire : 
d = D(ST) X X(t). ou 

35 - D(ST) est la donnee proportionnelle a la longueur L du sous-titre 

telle que definie precedemment. et 
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-X(t) une fonction croissante de la taiile d*une zone de la memoire Z2 
ou Z1 + Z2 vide de donnees. 

Avantageusement, la duree minimale d'affichage d'un sous-titre peut 
ainsi etre augmentee quand la taille de la zone de memoire vide de donnees 
5 augmente et diminuee quand la taille de la zone de memoire vide de donnees 
diminue. 

Selon un mode de realisation particulier du perfectionnement de 
rinvention, la donnee X(t) est calculee de fagon a tendre vers une donnee 
qui ne peut etre depassee. II est aiors avantageusement possible d'eviter une 
10 accumulation du retard d*affichage des sous-titres. 

Selon le mode de realisation preferentiel de Tinvention, la donnee 
X(t) est calculee selon un algorithme mettant en oeuvre des calculs de type PID 
(de Tabreviation Proportionnel/lntegral/Dlfferentiel). 

L'equation qui regit le regime proportionnel est donnee par la 

15 formule: 

Xp{t+At) = Kp X EM(t+At), ou 

- Kp est un nombre reel positif. et 

- EM(t+At) est une donnee representant la taille d'une zone de 
memoire vide de donnees a Tinstant t+At, Tinten/alle de temps At etant une 

20 duree representant la detection de deux sous-titres successifs dans le flux. A 
titre d'exemple non limitatif, At peut etre egal a la duree moyenne separant ta 
detection de deux sous-titres successifs calculee sur la base de n sous-titres 
precedemment detectes. n etant un nombre entier, par exemple. egal a 10. 

La donnee EM(t+At) peut etre egale soit au nombre N de buffers de 

25 visualisation ou de reception entierement vides de donnees a Tinstant t+At, soit 
au nombre N de buffers de visualisation ou de reception entierement vides de 
donnees a I'instant t+At plus, a ce meme instant. I'espace memoire vide de 
donnees du buffer de visualisation ou de reception en etat de decodage. 



30 Uequation qui regit le regime integral est donnee par la fomnule : 

Xi(t+At) = Kl x l(t+At), ou 

l(t+At) = l(t) - R, avec l(t+At) tel que -II < l(t+At) < 12 (11 et 12 positifs) 
etR = T^-Tp. 

Les valeurs 11 et 12 sont choisies de fapon a limiter I'influence du 
35 terme integral Xi(t+At). T^^ est Tinstant ou debute reellement I'affichage du sous- 
titre et Tr rinstant theorique ou le sous-titre doit etre affiche. La quantite R 
represente ainsi le retard calcule algebriquement entre Tinstant ou debute 
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r6ellement I'affichage du sous-titre et Tinstant theorique ou le sous-titre doit etre 
affiche. 

Dans le cas ou existe dans le flux un signal PTS relatif a I'affichage 
de sous-titre, I'instant Tr est la valeur du PTS. Dans le cas ou n^existe pas de 
5 signal PTS dans le flux, Tinstant Tr est une reference temporelle dont la valeur 
est telle que, par example, la quantite T^-Tp soit egale a y% de la duree de 
decodage du sous-titre, Tp etant Tinstant ou ie sous-titre est detecte dans le 
flux. A titre d'exemple non limitatif, y peutetre egal a 120. 

La duree d minimale d'affichage d un sous-titre croTt de la quantite R 
10 si R est negatif et decroTt de la quantite R si R est positif. Le terme integral 
Xi(t+At) permet ainsi une gestion avantageuse des retards r successifs. 

L'equation qui regit le regime differentiel est donnee par la formule : 

Xd(t+At) = -Kd x (EM(t+At)-EM(t))/ At 
15 ou Kd est un nombre reel positif. 

La contribution du tenme differentiel a la fonction X(t) permet 
avantageusement de prendre en compte la vitesse avec laquelle evolue la taille 
de la zone de memoire vide de donnees. 



20 Selon le mode de realisation preferentiel mentionne ci-dessus, la 

duree d'affichage d d'un sous-titre est calculee selon un algorithme mettant en 
oeuvre des calculs de type PID. II s'en suit qu'a I'instant t+At la duree d est 
proportionnelle a la grandeur Xp.i.d(t+At) telle que : 

Xp,i,d(t+At) = Xp(t+At) + Xi(t+At) + Xd(t+At) avec Xmin< 

25 Xp,i,d(t+At)<Xo, ou Xmin est, par exemple, une duree telle que la duree d soit 
sensiblement egale a 350ms, duree en dessous de laquelle un oeil humain ne 
prend plus conscience du passage d*un sous-titre ei Tecran, 

Uinvention concerne egalement d'autres algorithmes de calculs de la 
duree d. II peut s'agir, entre autres, d'un algorithme de calcul de type 

30 proportionnel (seul le tenme proportionnel tel que calcule ci-dessus intervient 
alors dans I'expression de X(t+At)), ou encore d un algorithme de calcul de type 
proportionnel/integral (seuls les termes proportionnel et integral tels que 
calcules ci-dessus interviennent alors dans Texpression de X(t+At)). De fa9on 
generate, comme mentionne precedemment. I'algorithme de calcul de la duree 

35 d minimale d'affichage d'un sous-titre est une fonction croissante d'une zone de 
memoire vive de donnees. Ualgorithme de calcul selon invention peut etre un 
algorithme mettant en oeuvre la logique floue. 
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Une fois calculee, la duree minimale d'affichage d'un sous-titre d est 
appliquee a un circuit (non represente sur la figure) qui commande Taffichage 
des donnees de sous-titres Dst issues du buffer de visualisation en etat 
d'affichage. La duree d'affichage du sous-titre est alors garantie comme ne 
pouvant pas etre inferieure a d. 



Bien sur, Tinvention n'est pas limitee au mode de realisation decrit. 
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REVENDICATIONS 

1. Dispositif pour gerer temporellement Texploitation de donnees 
detectees dans un flux de donnees et constituant au moins un ensemble de 

5 donnees, le dispositif comprenant un circuit de traitement des donnees 
detectees, une memoire (Z1 , 72) pemnettant de stocker ies donnees detect6es» 
las donnees en train d'etre traitees, !es donnees traitees destinees a etre 
exploitees et Ies donnees traitees en cours d'exploitation, {'exploitation des 
donnees traitees devant etre declenchee a un instant theorique donne (Tr), 
10 caracterise en ce qu1l comprend un circuit (MP) de calcul d'une duree minimale 
(d) d'exploitation des donnees proportionnelle a la quantite (L) de donnees 
contenues dans Tensemble de donnees. 

2. Dispositif selon la revendication 1, caracterise en ce que la duree 
15 minimale (d) est une fonction croissante de la taille d'une zone de la memoire 

(Z1 , Z2) vide de donnees. 

3. Dispositif selon la revendication 2, caracterise en ce que la dur6e 
minimale (d) est proportionnelle, a Tinstant t+At. a la grandeur Xp{t+At) telle que 

20 

Xp(t+At) = KpxEM(t+At) ou 

Kp est un nombre reel positif et EM{t+At) une donnee representant la 
taille de la zone de la memoire (Z1, Z2) vide de donnees a Tinstant t+At. At 
representant la duree separant la detection de deux ensembles de donnees 
25 successifs. 

4. Dispositif selon la revendication 3, caracterise en ce que la duree 
minimale (d) est proportionnelle, a Tinstant t+At, a la grandeur Xp,i(t+At) telle 
que : 

30 Xp.i(t+At) = Xp(t+At) + Ki x l(t+At), ou 

Ki est un nombre reel positif, et 
l(t+At) = l(t) - R avec l(t+At) tel que -II < I(t+At)<l2 et 
R = Ta - Tr, Ta etant Tinstant ou debute Texploitation des donnees et 
Tr rinstant theorique ou {'exploitation des donnees doit etre declenchee. 
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5. Dispositif selon la revendication 4. caracteris6 en ce que la dur6e 
minimale est proportionnelle, a Tinstant t+At. ^ la grandeur Xp.i,d(t+At) telle 
que : 

Xp.i,d(t+At) = XpJ(t+At) - Kd X (EM(t+A)-EM(t))/At), ou 
5 Kd est un nombre reel positif. 

6. Dispositif selon Tune quelconque des revendications 1 a 5, 
caracterise en ce que la zone de la nnennoire (Z1, Z2) pour stocker les donn6es 
traitees destinees a etre exploitees est divisee en differents espaces memoire 

10 contenant chacun un ensemble de donnees et en ce qu'il comprend un 
compteur (CNT) pour etiqueter les differents espaces memoire au fur et a 
mesure de leur remplissage de fa?on que les donnees exploitees soient celles 
contenues dans Tespace memoire etiquete en premier. 

15 7. Dispositif selon Tune quelconque des revendications 1 a 6. 

caracterise en ce que Tensemble de donnees detectees represente un sous- 
titre constitue de donnees codees detectees dans un flux de donnees 
vehiculees selon la norme de transport MPEG 2 System et en ce que le circuit 
de traitement est un circuit de decodage des donnees codees. Texploitation des 

20 donnees etant Taffichage des donnees decodees sur ecran. 

8. Decodeur fonctionnant selon la norme MPEG 2 video, caracterise 
en ce qu'il comprend un dispositif selon la revendication 7. 

25 9. Precede pour gerer temporellement I'exploitation de donnees 

detectees dans un flux de donnees et constituent au moins un ensemble de 
donnees. le precede comprenant une etape de stockage des donnees 
detectees, une etape de traitement des donnees stockees, une etape de 
stockage des donnees issues de Tetape de traitement et une etape 

30 d'exploitation des donnees stockees issues de Tetape de traitement. 
I'exploitation des donnees traitees devant etre declenchee a un instant 
theorique donne (Tr), caracterise en ce qu'il comprend une etape de calcul 
d'une duree minimale (d) d'exploitation des donnees proportionnelle a la 
quantite de donnees (L) contenues dans Tensemble de donnees. 
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10. Proc6de selon la revendication 9. caracterise en ce que la duree 
minimale (d) est une fonction croissants de la tailie d'une zone de stockage des 
donnees vide de donnees. 

5 11. Precede selon la revendication 10. caracterise en ce que la 

fonction croissante est proportionnelle a la grandeur Xp(t+At) telle que : 
Xp(t+At) = Kp X EM(t+At). ou 

Kp est un nombre reel positif et EM(t+At) une donnee repr6sentant la 
taille de la zone de stockage de donnees vide de donnees a Tinstant t+At, At 
10 etant une duree representant la detection de deux sous-titres successifs. 

12. Precede selon la revendication 11, caracterise en ce que la 
fonction croissante est proportionnelle a la grandeur Xp,i(t+At) telle que : 
Xp.i(t+At) = Xp(t+At) + Ki X l(t+At), ou 
15 Ki un nombre reel positif. et 

l(t+At) = Kt) - R avec l(t+At) tel que -II < l(t+At) < 12, et 

R = Ta-Tr,Ta etant Tinstant ou debute Texploitation des donnees 

et T R rinstant theorique ou Texploitation des donnees doit etre 

declenchee. 



20 



25 



30 



13. Precede selon la revendication 12, caracterise en ce que la 
fonction croissante est proportionnelle a la grandeur Xp,i,d(t+At) telle que : 

Xp,i,d(t+At) = XpJ(t+At) - Kd x (EM(t+At)-EM(t))/At), ou 
Kd est un nombre reel positif. 

14. Precede selon Tune quelconque des revendications 9 a 13. 
caracterise en ce quMI comprend une etape de cemptage permettant que les 
donnees exploitees soient les donnees issues de I'etape de traitement 
stockees depuis le plus longtemps. 



15. Precede selon l*une quelconque des revendications 9 a 14, 
caracterise en ce que Tensemble de donnees detectees dans le flux de 
donnees represente un sous-titre constitue de donnees codees dans un flux de 
donnees vehiculees selon la norme de transport MPEG 2 System, en ce que la 
35 traitement des donnees est le decodage des donnees codees et en ce que 
Texploitation des donnees est Taffichage des donnees decodees sur ecran. 
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16. Procede selon la revendication 15, caracteris6 en ce que la 
duree minimale (d) d'affichage des donnees decodees est proportionnelle a un 
parametre (m) dependant de moyens de ponderations Ii6s a la langue dans 
laquelle le sous-titre doit etre affiche. 
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1 . Base du rapport 

a. En ce qui concerne la langue, la recherche internationale a 6t6 effectuee sur la base de la demande internationale dans ta 
langue dans laquelle elle a 6t6 d^posde, sauf indication contraire donnee sous le mSme point. 

I I la recherche internationale a 6t6 effectuee sur la base d'une traduction de la demande internationale remise k I'administration. 
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d^pos^e avec la demande internationale, sous forme d^chiffrable par ordinateur. 

remis ult^rieurement ^ {'administration, sous forme 6crite. 

remis ult^rieurement k {'administration, sous forme d^chiffrable par ordinateur. 



2. 
3. 



□ 
□ 
□ 
□ 

□ 

□ 
□ 



La declaration, selon laquelle le listage des sequences pr^sent^ par 6crit et fourni ult^rieurement ne vas pas au-del^ de la 
divulgation faite dans la demande telle que depos^e, a ^t^ fournie. 

La declaration, selon laquelle les informations enregistr^es sous forme d6chiffrable par ordinateur sont identiques ^ celles 
du listage des sequences pr^sente par ecrit, a 6X6 fournie. 

II a 6te estim^ que certaines revendications ne pouvaient pas faire Tobjet d'une recherche (voir le cadre I). 
II y a absence d'unit^ de I'invention (voir le cadre II). 



4. En ce qui concerne le titre, 

PC] le texte est approuv^ tel qu'il a 6t6 remis par le d^posant. 

I I Le texte a 6X6 6Xab\\ par radministration et a la teneur suivante: 



5. En ce qui concerne Tabr^e, 

le texte est approuv6 tef qu'il a 6t6 remis par le d^posant 

□ le texte (reproduit dans le cadre III) a 6te etabfi par radministration conformement ^ la r^gle 38.2b). Le d^posant peut 
presenter des observations k radministration dans un d^lai d'un mois t compter de la date d'exp^dition du present rapport 
de recherche internationale. 

6. La figure des dessins k pubfier avec Tabr^ge est la Figure n* J 

\Y] sugg^r^e par le d^posant. Q Aucune des figures 

I — I , , n'est k publier. 
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I I parce que cette figure caract^rise mieux I'invention. 
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(54) Subtitle signal encoding/decoding 



(57) Subtitle encoding and/or decoding apparatus 
and corresponding method are operable to encode and/ 
or decode multiple subtitle signals representing multiple 
subtitles to be superimposed on a video image. Each 
received subtitle signal is encoded (in the encoding ap- 
paratus only) in a coder (78) and stored in a buffer mem- 
ory (82). An address list including data nodes therein is 
generated from the received subtitle signals wherein 
each data node in the address list corresponds to a re- 
spective subtitle stored in the buffer memory (82). Each 
data node includes data corresponding to the time and 
position at which a respective subtitle is to be superim- 
posed on a video image, as well as buffer memory ad- 
dress Information which identifies the location in the 
buffer memory (82) at which the respective subtitle is 
stored. Each data node further includes pointer data that 
identifies another data node that corresponds to a suc- 
cessively positioned subtitle In the display. Appropriate 
write and read address control signals are generated 
from the data in the address list by an address controller 
(84), and a subtitle signal is stored in and reproduced 
from the buffer memory (82) In accordance with the re- 
spective write and read address control signals. In the 
decoding apparatus (not shown), the read out subtitle 
signal Is decoded before being output. 
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Description 

The present invention relates to apparatus for and 
methods of encoding and/or decoding a subtitle signal, 
such that subtitle data nnay be efficiently encoded/de- 
coded to provide a subtitle signal representing one or 
more subtitles to be displayed on a video image. 

Referring to Fig. 1 of the drawings, a picture and 
subtitle encoding apparatus includes a picture encoding 
apparatus 20 and a subtitle coding apparatus 26. Pic- 
ture encoding apparatus 20 is comprised of an encoder 
unit 22 and a buffer memory 24, wherein a video image 
(i.e., a picture signal) is supplied to encoder unit 22, 
which may be an MPEG encoder, and which encodes 
the video signal in a manner well known in the art, and 
which supplies the encoded signal to buffer memory 24 
which temporarily stores the encoded signal therein. 
The encoded signal is read from buffer memory 24 and 
is supplied as a "picture stream" to a multiplexer 38. 
Buffer memory 24 also supplies a signal representing 
the amount of memory remaining in the buffer (i.e., un- 
used memory) to encoder unit 22 wh ich encodes the vid- 
eo signal in a particular manner (e.g., intraframe or in- 
terframe encodes the video signal) in response thereto. 

Subtitle coding apparatus 26 is comprised of a cod- 
er 28, a multiplexer 30, a buffer memory 32 and an ad- 
dress controller 34. A subtitle signal which represents a 
subtitle to be displayed on a video image, along with dis- 
play time data and display position data, are supplied to 
coder 28 which encodes each pixel of the subtitle rep- 
resented by the subtitle signal as a two-bit data code 
and supplies each of the data codes as a coded signal, 
along with the time and display position data, to multi- 
plexer 30. As is well known, coder 28 converts each pix- 
el of the subtitle to one of four different colors as repre- 
sented by the two-bit data code. Coder 28 additionally 
supplies a signal representing the amount of data of the 
subtitle signal to multiplexer 30 and further supplies the 
amount of data signal, along with the coded signal and 
the display and position data to address controller 34. 
Multiplexer 30 multiplexes the supplied signals into a 
multiplexed coded signal and supplies the multiplexed 
coded signal to buffer memory 32 which stores the sup- 
plied signal therein. Address controller 34, in response 
to the data amount signal and the display and position 
data, generates appropriate write and read control sig- 
nals, and supplies the write and read control signals to 
buffer memory 32 which stores the supplied multiplexed 
coded signal at a memory address as indicated in the 
write address control signal and reads therefrom data 
stored at a memory address as indicated in the read ad- 
dress control signal. Buffer memory 32 additionally sup- 
plies to coder 28 a buffer remaining amount signal rep- 
resenting the amount of unused memory remaining in 
the buffer so as to control the type of coding of the sub- 
title signal in coder 28. The coded signal stored in buffer 
memory 32 is read therefrom and supplied as a subtitle 
stream to multiplexer 30 which multiplexes the picture 
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stream and the subtitle stream to produce a combined 
picture and subtitle signal. The combined signal is trans- 
mitted over a transmission path or recorded on a record 
medium 40 by a recording device (not shown). 

s The picture and subtitle coding apparatus shown in 

Fig. 1 further includes a system clock generator 36 
which generates time information (i.e., a system clock 
signal) and supplies the time information to encoder unit 
22, coder 28, address controller 34 and multiplexer 38, 

10 and these devices utilize the time information so that 
they operate in a synchronous manner. 

Referring next to Fig. 2, a picture and subtitle de- 
coding apparatus is shown as comprising a picture de- 
coding apparatus 44 and a subtitle decoding apparatus 

?5 50, wherein the picture decoding apparatus 44 is com- 
prised of a buffer memory 46 and a decoder unit 48, and 
the subtitle decoding apparatus 50 is comprised of a 
buffer memory 52, a demultiplexer 54, a decoder 56 and 
an address controller 58. The video and subtitle data (i. 

20 e.. the combined picture and subtitle signal) is read from 
record medium 40 (or received over a transmission 
path) and supplied to a demultiplexer 42 which demul- 
tiplexes the supplied signal and supplies the video sig- 
nal (i.e., the picture stream) to picture decoding appa- 

25 ratus 44 and supplies the subtitle data (i.e., the subtitle 
stream) to subtitle decoding apparatus 50. 

The video signal supplied to picture decoding ap- 
paratus 44 is temporarily stored in buffer memory 46 be- 
fore being supplied to decoder unit 48 which decodes 

30 the video data at a time as indicated by the time infor- 
■ mation supplied by a system clock generator 60. Decod- 
er 48 decodes the video data in a manner well known 
in the art and supplies the decoded video signal as an 
output for display on a monitor (not shown). 

3S The subtitle data supplied to subtitle decoding ap- 
paratus 50 is stored in buffer memory 52 at an address 
as indicated by a write address control signal supplied 
from address controller 58, and buffer memory 52 reads 
the stored subtitle data therefrom from an address as 

40 indicated by a read address control signal also supplied 
from address controller 58. The read-out subtitle data is 
supplied to demultiplexer 54 which demultiplexes the 
coded signal, display time and position data, and data 
amount information therein and supplies the coded sig- 

45 nal (i.e., the subtitle signal) to decoder 56, supplies the 
display and position data to decoder 56 and to address 
controller 58, and supplies the data amount information 
also to decoder 56 and to address controller 58. Address 
controller 58 establishes the write and read address 

50 control signals that are supplied to buffer memory 52 
from the display time, position data and the data amount 
information, and in response to a control signal supplied 
from demultiplexer 42. Decoder 56 decodes the coded 
subtitle signal in a manner well know in the art and sup- 

55 plies the decoded signal at a time as indicated by the 
display start and end time information as well as from 
the display position data and time information supplied 
from system clock generator 60. The decoded subtitle 



2 



BNSDOCID:<EP 0765082A2> 



EP 0 765 082 A2 



signal is combined with the video signal that is output 
from picture decoding apparatus 44 in a connbining de- 
vice (not shown) such that the subtitle represented by 
the subtitle signal is superimposed on the video image. 

Fig. 3 schematically illustrates the data stored in 
buffer memory 52 and the superimposition of a subtitle 
on a video image displayed on a monitor (i.e. , a screen), 
wherein only one subtitle is stored in buffer memory 52 
and represented by "DATA 1 When only one subtitle is 
superimposed on a video image, such as shown in Fig. 
3, buffer memory 52 of the decoding apparatus and buff- 
er memory 32 of the encoding apparatus each operates 
as a FIFO (first-in-first-out) memory. 

Figs. 4 and 5 schematically illustrate when data of 
two subtitles are stored in buffer memory 52 and simul- 
taneously superimposed on a video image. For exam- 
ple, a first subtitle, represented by "DATA 1 is displayed 
with the video image from a time t1 until a time tV and 
is displayed at a lower portion of the image, and a sec- 
ond subtitle, represented by "DATA 2", is superimposed 
on the video image at a time t2 until a time t2' at an upper 
portion of the video image, such as shown in Fig. 4. Both 
subtitles are displayed from time t2 to time t1 '. If the data 
"DATA 1" of the first subtitle is supplied with the video 
signal before the data "DATA 2". of the second subtitle 
is supplied, then buffer memory 52 has the data struc- 
ture as shown in Fig. 5. Accordingly, when only the first 
subtitle is displayed (from time t1 to time t2), address 
controller 58 generates a read address control signal 
corresponding to the location in buffer memory 52 
whereat DATA 1 resides. Similarly, when only the sec- 
ond subtitle is displayed (from time tV to time t2'), ad- 
dress controller 58 generates a read address control 
signal corresponding to the location in buffer memory 
52 whereat DATA 2 resides. However, since the second 
subtitle is located above the first subtitle when both sub- 
titles are displayed (from time t2 to time t1 '), it is neces- 
sary for address controller 58 to generate a read ad- 
dress control signal that first corresponds to the location 
of DATA 2 in buffer memory 52 and then to the location 
of DATA 1 in buffer memory 52. Thus, DATA 2 is read 
from buffer memory 52 before DATA 1 is read therefrom 
for the time period occurring between time t2 and time 
tV and, thus, buffer memory 52 is not operating as a 
FIFO memory. 

Referring next to Figs. 6A and 6B, a schematic il- 
lustration of the data structure of buffer memory 52, as 
well as a schematic illustration of the times and positions 
at which four different subtitles are displayed. A first sub- 
title "DATA 1 " is stored in buffer memory 52 and dis- 
played at an upper portion of the video image, a second 
subtitle "DATA 2" is stored after DATA 1 in buffer memory 
52 and is displayed at a middle portion of the video im- 
age at a time when the first subtitle is still being dis- 
played. Upon termination of the display of the first sub- 
title, subtitle data DATA 1 corresponding thereto is 
erased from buffer memory 52, and a third subtitle DATA 
3 is stored after DATA 2 in buffer memory 52 and dis- 



played above the second subtitle in the video image. At 
this time, DATA 3 is read from buffer memory 52 before 
DATA 2 is read therefrom. A fourth subtitle DATA 4 sub- 
sequently is stored after DATA 3 in buffer memory 52 

5 and DATA 3 is read from memory, then DATA 2 is read 
from memory and then DATA 4 is read from memory for 
each frame until the termination of the display of the third 
subtitle DATA 3, at which time the third subtitle DATA 3 
is erased from buffer memory 52, as shown. The display 

70 of the second subtitle DATA 2 then is terminated and 
DATA 2 is erased from buffer memory 52 and, subse- 
quently, the display of the fourth subtitle DATA 4 is ter- 
minated and DATA 4 is erased from buffer memory 52. 
As can be appreciated from the foregoing description, 

75 buffer memory 52 cannot be controlled to operate as a 
FIFO type memory. Further subtitle data are not con- 
secutively stored in buffer memory 52 at each instance 
in time as shown in Fig. 68. Still further due to the com- 
plex control of buffer memory 52 and since subtitle data 

20 are not consecutively stored therein, the control of buffer 
memory 32 of the coding apparatus shown in Fig. 1 does 
not coincide with the control of buffer memory 52 of the 
decoding apparatus shown in Fig. 2. Thus, overflow 
and/or underflow of data stored in buffer memories 32 

25 and 52 is possible, which results in the inherent limiting 
of the number of subtitles that can be displayed on a 
video image and the arrangement thereof. 

In accordance with one embodiment of the present 
invention, apparatus and method are provided for re- 

20 ceiving a subtitle signal which represents a subtitle to 
be superimposed on a video image, encoding the sub- 
title signal, generating an address list from the display 
time and display position data which are included in the 
subtitle signal and which represent a time and position 

3S at which the subtitle is to be superimposed on the video 
image, generating a write address signal, generating a 
read address signal in accordance with the generated 
address list, storing the coded subtitle signal in a mem- 
ory in accordance with the write address signal, reading 

40 the stored coded subtitle signal from the memory in ac- 
cordance with the read address signal, and supplying 
as an output signal the coded subtitle signal read from 
the memory. 

As one aspect of the present invention, a data node 
45 is added to the address list each time a new subtitle (i. 
e., subtitle signal) is received, wherein the added data 
node includes data that corresponds to the display time 
and position data included in the newly received subtitle 
signal and also includes memory location data which 
50 represents a location in the memory at which the newly 
received subtitle signal is stored. 

As a feature of this aspect, each data node in the 
address list further includes respective pointer data that 
identifies another data node in the address list that cor- 
55 responds to a subtitle that is to be superimposed posi- 
tionally after the subtitle that corresponds to the respec- 
tive data node. 

Read address signals may be generated that cor- 



3 



BNSOOCID: <EP 0765082A2> 



EP 0 765 082 A2 



respond to each coded subtitle that is to be read from 
the memory in an order as Indicated by the respective 
pointer data of each data node in the address list. 

As another aspect of the present invention, a coded 
subtitle signal including display time data which repre- s 
sents an end time that is earlier than a current time and 
which is stored in the memory is erased therefrom only 
if there is no coded subtitle signals that precede this cod- 
ed subtitle signal in the memory. 

In accordance with another embodiment of the 
present invention, apparatus and method are provided 
for receiving a coded subtitle signal, generating an ad- 
dress list from the display time data and the display po- 
sition data included in the coded subtitle signal, gener- 
ating a write address signal, generating a read address ^5 
signal in accordance with the generated address list, 
storing the coded subtitle signal in a memory in accord- 
ance with the write address signal, reading the stored 
coded subtitle signal from the memory in accordance 
with the read address signal, and decoding the read out 20 
coded subtitle signal to produce a decoded subtitle sig- 
nal. 

Embodiments of the present invention provide ap- 
paratus and a method for encoding and decoding a sub- 
title signal which can overcome the shortcomings of the 
previously-described devices. 

In preferred encoding and decoding techniques, 
control of a buffer memory which stores subtitle data is 
simplified. 

The preferred apparatus includes a respective buff- ^0 
er memory which is controlled to operate as a Fl FO type 
memory device. 

The invention will now be described by way of ex- 
ample with reference to the accompanying drawings, 
throughout which like parts are referred to by like refer- 3S 
ences, and in which: 

Fig. 1 is a block diagram of a picture and subtitle 
encoding apparatus; 

Fig. 2 is a block diagram of a picture and subtitle 40 
decoding apparatus; 

Fig. 3 schematically illustrates the storage and dis- 
play of one subtitle; 

Fig. 4 schematically illustrates the time and position 
at which two subtitles are displayed on a video im- 

age; 

Fig. 5 schematically Illustrates the storage and dis- 
play of two subtitles; 

Figs. 6A and 6B schematically illustrate the time 
and position at which four subtitles are displayed on so 
a video image and the storage thereof in a buffer 
memory; 

Fig. 7 Is a block diagram of apparatus for encoding 
a picture and subtitle signal including a subtitle en- 
coding apparatus in accordance with the present In- 55 
vention; 

Fig. 8 is a block diagram of a picture and subtitle 
decoding apparatus including a subtitle decoding 



apparatus in accordance with the present invention; 
Fig. 9 schematically illustrates the storage and dis- 
play of two subtitles in accordance with the present 
Invention; 

Fig. 10 schematically illustrates the data structure 
of an address list in accordance with the present 
invention; 

Figs. 11 A - 11c schematically illustrate the data 
structure of an addressed list during various times 
at which two subtitles are displayed in accordance 
with the present invention; 

Figs. 12A and 12B schematically illustrate the time 
and position at which four subtitles are displayed on 
a video image and the storage thereof In a buffer 
memory in accordance with the present Invention; 
Fig. 1 3 is a flow chart of the operation of the address 
controllers of the present invention when anewsub- 
title is received; 

Fig. 1 4 is a flow chart of a decoding operation when 
two subtitles are supplied in accordance with the 
present Invention; 

Figs. 15A and 15B are flow charts illustrating the 
decoding operation of the present invention when 
three or more subtitles are supplied; 
Fig. 16 is a flow chart of an encoding operation 
when two subtitles are supplied in accordance with 
the present invention; and 

Figs. 17A and 178 are flow charts illustrating the 
encoding operation of the present invention when 
three or more subtitles are supplied. 

Referring now to Fig. 7 of the drawings, a block di- 
agram of a picture and subtitle coding apparatus includ- 
ing a subtitle coding apparatus in accordance with an 
embodiment of the present invention is shown. The pic- 
ture and subtitle coding apparatus is comprised of a pic- 
ture encoding apparatus 70, which includes therein an 
encoder unit 72 and a buffer memory 74, and a subtitle 
coding apparatus, which Includes therein a coder 78, a 
multiplexer 80, a buffer memory 82, an address control- 
ler 84 and an address list memory 86. 

Picture encoding apparatus 70 operates In a man- 
ner similar to that of picture encoding apparatus 20, pre- 
viously discussed with reference to Fig. 1 , and, thus, fur- 
ther description thereof is removed herein except where 
necessary for an understanding of the present inven- 
tion. 

A subtitle signal representing a subtitle to be super- 
imposed on the video image is supplied to coder 78 of 
subtitle coding apparatus 76 which operates to encode 
each pixel of the subtitle into a four bit data code thus 
corresponding to one of 16 colors. The coded subtitle 
data, along with a signal Indicating the amount of data 
in the coded signal and display time and display position 
data are supplied to multiplexer 80 which multiplexes 
the supplied signals and which supplies the multiplexed 
signal to buffer memory 82 which temporarily stores the 
multiplexed signal therein. Coder 78 further supplies the 
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data amount signal and the time and position data to 
address controller 84 which generates an address list 
therefronn (to be discussed) and stores the address list 
in address list memory 86. Address controller 84 further 
generates write and read address control signals from 
the address list stored in memory 86 (also to be dis- 
cussed) and supplies the write and read address control 
signals to buffer memory 82. Buffer memory 82 stores 
the multiplexed coded signal supplied thereto at a mem- 
ory address therein as indicated in the write address 
control signal and reads data from an address as indi- 
cated in the read address control signal and supplies 
the read out data as a subtitle stream to multiplexer 90. 
Buffer memory 82 further supplies a control signal rep- 
resenting the amount of unused memory in the buffer to 
encoder 78 which, in response thereto, codes the sub- 
title signal in a manner well known in the art to prevent 
overflow or underflow of data in buffer memory 82. 

System clock generator 88 supplies time informa- 
tion (i.e., a system clock signal) to encoder unit 72, coder 
78, address control 84 and multiplexer 90 and these de- 
vices are controlled to operate in a synchronous man- 
ner. Multiplexer 90 multiplexes the picture stream signal 
supplied from picture encoding apparatus 70 and a sub- 
title stream supplied from subtitle coding apparatus 76, 
and supplies the multiplexed signal for transmission 
thereof over a transmission path or, alternatively, to a 
recording device (not shown) which records the multi- 
plexed signal on a record medium 92. 

Fig. 8 is a block diagram of a decoding apparatus 
which is comprised of a picture decoding apparatus 96 
and a subtitle decoding apparatus 102 in accordance 
with the present invention. Picture decoding apparatus 
96 is comprised of a buffer memory 98 and a decoder 
unit 100, and operates in a manner similar to that of pic- 
ture decoding apparatus 44 shown in Fig. 2 and, thus, 
further description thereof is omitted herein except 
where necessary for an understanding of the present 
invention. 

Subtitle decoding apparatus 102, in accordance 
with the present invention, is comprised of a buffer mem- 
ory 1 04, a demultiplexer 1 06, a decoder 1 08, an address 
controller 1 1 0 and an address list memory 112. The cod- 
ed multiplexed picture and subtitle signal is received 
over a transmission path, or alternatively, is reproduced 
from record medium 92 in a reproducing device (not 
shown), and the coded multiplexed signal is supplied to 
a demultiplexer 94 which demultiplexes the signal into 
its coded picture and coded subtitle components. The 
coded picture signal is supplied as a picture stream to 
picture decoding apparatus 96 which temporarily stores 
the picture stream in buffer memory 98 and decodes in 
decoder unit 100 the coded signal in a manner well 
known in the art. The decoded picture signal is supplied 
as an output signal at a time as controlled by a time in- 
formation signal supplied from a system clock generator 
114. 

Demultiplexer 94 supplies the coded subtitle signal 



to buffer memory 1 04 in subtitle decoding apparatus 1 02 
which stores the supplied signal at a memory address 
therein as indicated in a write address control signal 
supplied from address controller 110. Buffer memory 

5 104 reads the stored subtitled data from a memory ad- 
dress as indicated in a read address control signal sup- 
plied from address controller 110 and supplies the read 
out signal to demultiplexer 1 06 which demultiplexes the 
subtitle data into its respective coded subtitle signal, da- 

70 ta amount signal, and time and position signal compo- 
nents. The coded subtitle signal, data amount signal and 
time and position signals are supplied to decoder 108 
which decodes the respectively supplied signals in a 
manner well known in the art and which supplies a de- 

15 coded subtitle signal representing a subtitle to be super- 
imposed on a video image at an appropriate time as in- 
dicated by the time and position data supplied thereto. 

Address controller 1 1 0 generates from the supplied 
time and position data an address list (to be discussed) 

20 and supplies the generated address list to address list 
memory 112 which stores the address list therein. Ad- 
dress controller 110 further generates the write and read 
address control signals from the address list stored in 
memory 112 as well as from the time information sup- 

25 plied from system clock generator 114, and supplies the 
generated write and read address control signals to buff- 
er memory 104. 

The generation of an address list by both address 
controller 84 of the subtitle coding apparatus and ad- 

30 dress controller 110 of the subtitle decoding apparatus 
will now be discussed with reference to Figs. 9, 10 and 
1 1 A - 1 1 C. However, for purposes of the present discus- 
sion, since the operation of address controllers 84 and 
110 are substantially similar, the discussion herein will 

35 be directed to the operation of address controller 110, 
but it is understood that the functions and operations of 
address controller 110 also are applicable to address 
controller 84. 

When two subtitles are supplied with the video pic- 

40 ture, a first subtitle, represented by "DATA 1", is stored 
in buffer memory 1 04 at a first memory address therein, 
as shown in the left hand portion of Fig. 9. Address con- 
troller 110 generates appropriate write address control 
signals so that buffer memory 104 successively stores 

45 the subtitle data of the first subtitle (DATA 1) at a top 
memory address (or first memory address) of buffer 
memory 104. Upon receipt of the first subtitle data (and 
storage thereof in buffer memory 104), address control- 
ler 1 1 0 generates a first data "node" which contains var- 

50 ious data including the first and last addresses (start ad- 
dress and end address) of buffer memory 104 at which 
the first subtitle DATA 1 is stored, the display start and 
end times at which the first subtitle is to be superim- 
posed on the video image, and the display start and end 

55 positions at which the first subtitle is to be superimposed 
on the video image. The first node is illustrated in Fig. 
10 as the "node of DATA 1". The DATA 1 node (as well 
as all other nodes, as will be seen) further includes 
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"pointer" data which identifies (or "points" to) the node 
of the next subtitle to be positionally displayed (i.e., su- 
perimposed) on the video innage. If only one subtitle, e. 
g., subtitle DATA 1, is stored in buffer memory 104, then 
the DATA 1 node includes a pointer that indicates that 
this node is the last node in the address list or, alterna- 
tively, includes a pointer that identifies (points to) an 
"end pointer" (or "end" node), such as shown in Fig. 11 A. 
The end pointer represents the end of the address list. 
The pointer of each node may identify a particular mem- 
ory address of address list memory 1 1 2 at which the suc- 
cessive node is located or may identify an assigned 
node value, for example, node 1, node 2, etc., whereat 
the location of a given node value in the address list is 
known or predetermined. 

In accordance with the present invention, for each 
videoimage (e.g., field or frame) that is to be output from 
picture decoding apparatus 96, address controller 110 
"cycles" through the address list wherein the first node 
of the address list is read (or pre-read) from address list 
memory 1 1 2, and which location may be identified by an 
"initial" pointer (see Fig. 1 1 A), and based on the data of 
the first node (in this case, the first node represents the 
first subtitle DATA 1), the first subtitled data is or is not 
read from buffer memory 104 (as controlled by the read 
address control signal). That is, if the time information 
represents a time between the display start and end 
times of the first subtitle, the first subtitle is read from 
memory 104 from the locations therein as indicated by 
the start and end address data included in the node and 
at an appropriate time during the output of a given frame 
as indicated by the display start and end position data 
stored in the node. Thus, after a node is generated and 
stored in the address list corresponding to a particular 
subtitle stored in buffer memory 104, the node includes 
all of the information that is necessary to determine if 
and when the subtitle stored in buffer memory 104 is to 
be read therefrom, decoded in decoder 108 and subse- 
quently superimposed on the video image. After the first 
node is processed, that is, after it is determined whether 
the subtitle corresponding to that node is to be read from 
buffer memory 1 04 (and the reading, if any, thereof), the 
next node that is identified by the pointer of the first node 
is read (or pre-read) from the address list stored in mem- 
ory 112, and this next node then is processed. Of 
course, if only one subtitle is stored in buffer memory 
1 04, then no other nodes, except perhaps an EN D node, 
exists in the address list. 

A second subtitle, for example, subtitle "DATA 2", is 
supplied to buffer memory 1 04 and is stored at a location 
therein immediately after the first subtitle DATA 1 , such 
as illustrated in the left hand portion of Fig. 9. A second 
data node, called "the DATA 2 node", is generated in 
address controller 110 and includes data pertaining to 
the start and end addresses of buffer memory 104 at 
which the second subtitle is stored, display start and end 
times at which the second subtitle is to be superimposed 
on the video image, and display start and end positions 
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of the second subtitle in the video image. Still further, 
and in accordance with the present invention, the point- 
er of each node in the address list is established to re- 
flect the read-out order of the subtitles stored in buffer 

5 memory 104 and which depends solely on the display 
start and end positions of each of the subtitles. That is, 
the pointer of the "initial node" or "initial pointer" is es- 
tablished (i.e., modified) to point to the second node 
since the second subtitle is located positionally before 
(i.e., above) the first subtitle in the video image, as 
shown in the right hand portion of Fig. 9. Thus, it is nec- 
essary to process the second node before the first node 
for each frame of the video picture. The pointer of the 
second node is established to point to the first node of 

75 the address list since the first subtitle occurs after (po- 
sitionally) the second subtitle. Finally the pointer of the 
first node is established (if not already) to point to the 
"end pointer" since the first subtitle DATA 1 is the posi- 
tionally last subtitle. It is important to note that the 

20 above-discussed pointer order is established regard- 
less of the display start and end times of each of the 
subtitles and, instead, is solely based on the display 
start and end positions of each of the subtitles. Thus, for 
each video frame that is output from picture decoding 

25 apparatus 96, the second node corresponding -to the 
second subtitle DATA 2 is processed (to determine if the 
second subtitle is to be read from buffer memory 104, 
decoded and superimposed on the image) before the 
first node is processed since the second subtitle is po- 

30 sitionally located on the screen before the first subtitle. 
Fig. 10 illustrates the data structure of the address list 
when the first and second subtitles DATA 1 and DATA 
2, shown in Fig. 9, are stored in buffer memory 104. 
When the two subtitles DATA 1 and DATA 2 are 

35 stored in buffer memory 104, as previously discussed, 
address controller 110 for each frame processes node 
2 and then processes node 1, and for each node con- 
trols the buffer memory to read out the respective sub- 
title when the system clock represents a time between 

40 the display start and end times of that subtitle. Assuming 
that display start time t1 occurs before display start time 
t2, and that time t2 occurs before display end time tV, 
and that time t1 ' occurs before display end time t2' (see 
Fig. 4),. when the system clock represents a time be- 

^5 tween time t1 and time t2, the second subtitle DATA 2 
is not read from buffer memory 104 when the second 
node is processed, but the first subtitle DATA 1 is repro- 
duced, decoded and output from the subtitle decoding 
apparatus of the present invention when the first node 

50 is processed and, thus, only the first subtitle is superim- 
posed on the video image between times t1 and t2. 
When the system clock represents a time between time 
t2 and t1 ' , the second subtitle is read from buffer memory 
104, decoded and superimposed on the video image 

55 and the first subtitle DATA 1 is read from buffer memory 
104, decoded and superimposed on the video image. 
When the system clock represents a time between time 
tV and time t2', only the second subtitle is read from 
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buffer memory 104, decoded and superimposed on the 
video image. In addition, at display end time t1 the first 
subtitle is erased from buffer memory 104 (to be dis- 
cussed) and the first node corresponding to the first sub- 
title is erased from the address list, and the pointers of 
each of the remaining nodes in the address list are re- 
established, such as shown in Fig. 1 1 C. Only the second 
subtitle now is stored in buffer memory 1 04, and, there- 
fore, the initial pointer points to the second node and the 
pointer of the second node points to the end pointer. 

The operation of the subtitle decoding apparatus of 
the present invention when four subtitles are supplied 
with the video signal will now be discussed with refer- 
ence to Figs. 12A and 12B. As shown in Fig. 12A, the 
first subtitle DATA 1 is supplied to and stored in buffer 
memory 104. Fig. 12B illustrates the data structure of 
buffer memory 104, wherein the first subtitle DATA 1 is 
stored at a beginning memory location therein. At this 
time, an address list is generated in address controller 
1 1 0 which includes a first node corresponding to the first 
subtitle DATA 1 , and at the display start time of the first 
subtitle, the first subtitle is superimposed on the video 
image. The second subtitle DATA 2 subsequently is sup- 
plied to and stored in buffer memory 1 04, and a second 
node corresponding to the-second subtitle is added to 
the address list, wherein the pointer of the first node 
points to the second node since the second subtitle po- 
sitionally occurs after the first subtitle in the video image. 
Then, both the first and second subtitles are superim- 
posed on the video image at the display start time of the 
second subtitle. When the display end time t1 ' of the first 
subtitle is reached (not shown in Fig. 1 2B), the first sub- 
title DATA 1 is erased from buffer memory 104 and the 
first node is removed from the address list, and the initial 
pointer is set to point to the second node of the address 
list. 

When a third subtitle DATA 3 is supplied to buffer 
memory 104, it is stored immediately after the second 
subtitle therein, and a third node corresponding to the 
third subtitle is added to the address list. Also, and as 
previously discussed, the pointers of each of the nodes 
(i.e., nodes 2 and 3) are established such that the initial 
pointer points to the third node and the pointer of the 
third node points to the second node. When the display 
start time t3 of the third subtitle is reached, both the third 
and second subtitles are superimposed on the video im- 
age. 

When a fourth subtitle DATA 4 is supplied to buffer 
memory 104. it is stored after the third subtitle therein 
and a fourth node is added to the address list. Further, 
since the fourth subtitle positionally occurs after the sec- 
ond subtitle in the video image, the pointer of the second 
node is established to point to the fourth node, and the 
pointer of the fourth node is established to point to the 
end pointer. When the display start time t4 of the fourth 
subtitle is reached, the third, second and fourth subtitles 
each are read from buffer memory 104 (in this order), 
decoded and superimposed on the video image. 



As shown in Figs. 1 2A and 1 2B, at the display end 
time t3' of the third subtitle, the superimposition of the 
third subtitle on the display is terminated, but the third 
subtitle is not erased from buffer memory 104 and the 

5 third node is not removed from the address list for rea- 
sons to be discussed. When the display end time t2' of 
the second subtitle is reached, both the second and third 
subtitles are erased from buffer memory 104 and the 
second and third nodes are removed from the address 

10 list, as shown in Fig. 12B. Then, since only the fourth 
subtitle is stored in buffer memory 104. the initial pointer 
is established to point to the fourth node. Finally, when 
the display end time t4' of the fourth subtitle is reached, 
the fourth subtitle is removed from buffer memory 104 

IS and the fourth node is removed from the address list (not 
shown in Fig. 12B). 

As mentioned above, when the display end time t3' 
of the third subtitle is reached, the third subtitle is not 
erased from buffer memory 104 and the third node is 

20 not removed from the address list. In accordance with 
the present invention, when subtitle data exists in buffer 
memory 104 which precedes a "current" subtitle which 
superimposition thereof on a video image has just been 
terminated, the "current" subtitle is not removed from 

25 memory and the node corresponding to the "current" 
subtitle is not removed from the address list. The 
present invention seeks to operate buffer memory 104 
as a FIFO type memory device which provides several 
advantageous features to the present invention. For ex- 

30 ample, overflow or underflow of data in the buffer is pre- 
vented by the aforementioned operation since a signal 
representing the amount of unused memory in the buffer 
memory (produced thereby) represents a true value of 
useable space that is available for other subtitle data. 

35 As another example, leaving the above-discussed sub- 
title data in buffer memory 104 even after the termination 
of the display of the subtitle simplifies the control of the 
buffer memory 

Thus, and in accordance with the present invention, 

40 a subtitle is erased from buffer memory 104 upon termi- 
nation of the display thereof if no data precedes that sub- 
title in memory. In addition, if data (i.e., subtitle data) 
exists that precedes the subtitle (which display thereof 
is terminated) represents a subtitle (or subtitles) which 

45 display thereof already is terminated, then both of these 
subtitles are erased from buffer memory 104 and the 
nodes corresponding thereto are removed from the ad- 
dress list. The cases in which subtitle data is erased or 
is not erased from buffer memory 104 is further de- 

50 scribed below with reference to Figs. 14-1 7. 

Fig. 1 3 is a flow chart of the operation of both ad- 
dress controller 84 of subtitle coding apparatus 76 (Fig. 
7) and address controller 1 10 of subtitle decoding appa- 
ratus 102 (Fig. 8) when one or more subtitles are sup- 

55 plied thereto. The operation begins at instruction SI 
and, at inquiry S2, it is determined whether a new sub- 
title is received. In the subtitle coding apparatus 76, a 
new subtitle is received when it is provided to coder 78, 
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and in subtitle decoding apparatus 102, it is determined 
that a subtitle is received when demultiplexer 94 sup- 
plies an appropriate control signal to address controller 
110 which indicates the receipt of a new subtitle. If a new 
subtitle is not received, then the operation is terminated, 
but if a subtitle is received, header information of the 
newly received subtitle data is read therefrom at instruc- 
tion S3, such header information including the start and 
end time data, as well as the display start and end po- 
sition data of the supplied subtitle. A new data node is 
generated from the header information at instruction S4 
and, at instruction S5, the position data of each node in 
the address list is read and, at instruction S6, it is decid- 
ed where in the address list the new node is to be in- 
serted depending on the respective values of the posi- 
tion data of each of the nodes. The node is inserted at 
the appropriate location in the address list at instruction 
S7 and the operation is terminated. Although the oper- 
ation of both address controllers has been described 
with reference to the flow chart of Fig. 1 3 as inserting a 
node at the appropriate location in the address list, the 
node also may be added to the end of the address list 
wherein the pointer of each of the nodes is modified in 
accordance with the position of each of the subtitles, as 
previously discussed. 

Fig. 14 is a flow chart of the operation of address 
controller 110 of subtitle decoding apparatus 102 when 
two subtitles are supplied subtitle decoding apparatus 
102, and Figs. 15A and 15B represent a flow chart of 
the operation of address controller 110 when three or 
more subtitles are supplied to subtitle decoding appara- 
tus 1 02. Referring first to Fig. 1 4, after two subtitles have 
been stored in buffer memory 104 and two nodes rep- 
resenting the two subtitles are provided as the address 
list, the process begins at instruction S21 and, at inquiry 
S22, it is determined whether each and every node in 
the address list has been processed for a video image 
(i.e., field or frame) of the video picture. If so, the oper- 
ation is terminated at instruction S23, but, if not, the next 
node (i.e. , the first node or the second node) is read from 
the address list in the order specified by the pointers, 
previously discussed, at instruction S24. 

The status of the display of the subtitle of the cur- 
rently processed node (herein, called the "current" sub- 
title) is determined at inquiry S25. If the present time, as 
indicated by the system clock, is before the display start 
time of the current subtitle, then the operation proceeds 
back to instruction S22 at which point the next node is 
processed. If, however, it is determined that the current 
subtitle is to be displayed, as when the system clock is 
between the start and end times of the current subtitle, 
then, at instruction S26, the subtitle is read from buffer 
memory 104 from a location therein as indicated by the 
start and end addresses of the node, and the read-out 
subtitle data is decoded and displayed (i.e., superim- 
posed on the video image). However, if it is determined 
that the display of the subtitle is terminated, as when the 
display end time is reached, the subtitle is erased from 
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buffer memory 74 and the current node is removed from 
the address list at instruction S27. The operation of ad- 
dress controller 110 then proceeds back to inquiry S22. 
As previously discussed, when a node is removed 

5 from the address list, the pointers of each of the remain- 
ing nodes in the address list are re-established in the 
manner previously discussed. 

The operation of address controller 1 1 0 when three 
or more subtitles are supplied to the subtitle decoding 

10 apparatus of the present invention is shown in Figs. 
15A-15B, wherein for each video image (frame), the 
process begins at instruction S31 and, at inquiry S32, it 
is determined whether all of the data nodes in the ad- 
dress list have been processed. If so, the process of 

?5 Figs. 15A-15B is terminated at instruction S33. But, if 
not, the next node in the address list (starting with the 
node pointed to by the initial pointer) is read from mem- 
ory 112 at instruction S34. Similar to inquiry S25 (Fig. 
14), the status of the subtitle of the current node is de- 

20 termined at inquiry S35, and if it is determined that the 
subtitle is not yet to be displayed, then the process pro- 
ceeds back to inquiry S32. However, if it is determined 
that the current subtitle is to be displayed, then the sub- 
title is read from buffer memory 104, decoded and dis- 

25 played (i.e., superimposed on the video image) at in- 
struction S36, and the process then proceeds back to 
inquiry S32. 

If it is determined at inquiry 835 that the display of 
the current subtitle is or already is terminated, then the 

30 process proceeds to inquiry S37 whereat it is deter- 
mined if any subtitle data exists before the current sub- 
title in buffer memory 104. If no data precedes the cur- 
rent subtitle in buffer memory 104, then the current sub- 
title is erased from buffer memory 104 and the current 

35 node is removed from the address list at instruction S38, 
and the process proceeds back to inquiry S32. However, 
if data exists before the currently processed subtitle in 
buffer memory 74, then it is determined, at inquiry S39 
(Fig. 1 5B) if the subtitle that precedes the current subtitle 

40 in buffer memory 104 is currently being displayed. If so, 
the current subtitle is not read from buffer memory 104 
(i.e., not displayed, but also not removed from memory) 
and the process proceeds back to inquiry S32. However, 
if the subtitle that precedes the current subtitle is not 

45 being displayed anymore (i.e. , the system clock has ex- 
ceeded the display end time of the preceding subtitle), 
then both the preceding and current subtitles are erased 
from buffer memory 104 and the nodes corresponding 
to the preceeding and current subtitles are removed 

50 from the address list at instruction S41 . Then, at inquiry 
S42, it is determined if a subtitle exists after the current 
subtitle (which has just been erased) in buffer memory 
104. If so, the process proceeds to inquiry S43, but, if 
not, the process proceeds back to inquiry S32. At inquiry 

55 S43, it is determined if the display of the succeeding 
subtitle is terminated, as indicated by time data of the 
node of the successive subtitle. If so, then the succes- 
sive subtitle is erased from buffer memory 104 and the 
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node corresponding to that subtitle is removed from the 
address list at instruction S44. Then, or if the display of 
the successive subtitle is not terminated, the process 
proceeds back to inquiry S32. 

Fig. 16 is a flow chart of the operation of address 
controller 84 of subtitle coding apparatus 76 when two 
subtitles are supplied thereto. The flow chart of Fig. 16 
is substantially similar to the flow chart of Fig. 1 4, which 
represents the operation of address controller 110 of 
subtitle decoding apparatus 102 when two subtitles are 
supplied, in that inquiry S52, instructions S53-S54, in- 
quiry S55 and instruction 5S are the same as inquiry 
S22, instructions S23-S24, inquiry S25 and instruction 
S27, respectively. Therefore, a description thereof is 
omitted herein. However, when address controller 84, 
at inquiry S55, determines that a currently processed 
subtitle (i.e., node) is to currently displayed, then it is 
determined at inquiry S56, if the current time, as indicat- 
ed by the system clock signal, represents the display 
start time of the current subtitle. If so, the subtitle is read 
from buffer memory 82 and subsequently multiplexed 
with the video image for recording or transmission there- 
of. If not, the process proceeds back to inquiry S52. 
Thus, address controller 84 operates to control buffer 
memory 82 in subtitle coding^apparatus 76 to supply a 
subtitle for multiplexing with the video signal at the time 
when that subtitle is to be superimposed on the video 
image. 

Referring next to Figs. 1 7A and 1 7B, a flow chart of 
the operation of address controller 84 when three or 
more subtitles are provided is shown. The flow chart of 
Figs. 17A - 17B is substantially the same as the flow 
chart of Figs. 1 5A - 1 5B and, thus, a description of those 
instructions and inquiries that are the same therein are 
omitted herein. However, in the flow chart of Figs. 17A 
- 1 78, when it is determined at inquiry S65 that a current 
subtitle is to be displayed, the process proceeds to in- 
quiry S66 at which time it is determined whether the cur- 
rent time, as indicated by the system clock signal, is 
equal to the display start time of the subtitle. If so, the 
current subtitle is read from buffer memory 82 in a man- 
ner similar to that discussed above with reference to the 
flow chart of Fig. 16. If not, the process proceeds to in- 
quiry S62. In addition, it is determined, at inquiry S70, if 
the preceeding subtitle in buffer memory 82 is being dis- 
played, and if so, the current subtitle is not displayed 
(and not erase from memory), at instruction S71 . 

From the above discussion, it is seen that both buff- 
er memories 82 and 104 are controlled to operate as 
first-in-first-out memory devices so that the control 
thereof may be simplified and, further, so as to prevent 
the underflow/overflow of data therein. By using an ad- 
dress list which includes nodes which each corresponds 
to a respective subtitle stored in the buffer memories, 
and by providing in each node various subtitle data in- 
cluding the display start and end time data, the display 
start and end position data, and the start and end ad- 
dresses at which the subtitle data is stored, as well as 
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a pointer which points to a successive subtitle that is to 
be displayed positionally on the video image, allows for 
the simplified processing and control of a multiple 
number of subtitles. 

While the present invention has been particularly 
shown and described in conjunction with preferred em- 
bodiments thereof, it will be readily appreciated by those 
of ordinary skill in the art that various changes may be 
made without departing from the spirit and the scope of 
the invention. For example, although the specific block 
structure of the subtitle coding and decoding apparatus 
has been shown and described, the present invention 
is not limited to this specific block structure and may be 
applied to other types of block structures and circuits 
which involve the superimposttion or display of subtitles 
or other video data. 

Therefore, it is intended that the appended claims 
be interpreted as including the embodiments described 
herein, the alternatives mentioned above, and all equiv- 
alents thereto. 



Claims 



25 1. Apparatus for coding a subtitle signal, comprising; 



means for receiving a subtitle signal represent- 
ing a subtitle to be superimposed on a video 
image, said subtitle signal including display 
time data representing a time at which said sub- 
title is to be superimposed and display position 
data representing a location in said video image 
at which said subtitle is to be superimposed; 
encoding means for encoding the received sub- 
title signal to produce a coded subtitle signal; 
storage means for temporarily storing the cod- 
ed subtitle signal in accordance with a write ad- 
dress signal and for reading out the stored cod- 
ed subtitle signal in accordance with a read ad- 
dress signal; 

storage control means for generating an ad- 
dress list from said display time data and said 
display position data and for generating said 
read address signal and said write address sig- 
nal in accordance with the generated address 
list; and 

means for supplying as an output signal the 
coded subtitle signal read from said storage 
means. 



30 



35 



40 



45 



50 



55 



The apparatus of claim 1 , wherein said storage con- 
trol means is operable to add a data node to said 
address list each time a subtitle signal representing 
a respective subtitle is received, said data node in- 
cluding data corresponding to said display time data 
and said display position data included in said sub- 
title signal, said data node further including memory 
location data representing a location in said storage 
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means at which said coded subtitle signal is stored. 

The apparatus of claim 2, wherein each data node 
in said address list further includes respective point- 
er data identifying another data node in said ad- 5 
dress list corresponding to a subtitle to be superim- 
posed positionally after the subtitle corresponding 
to the respective data node. 

The apparatus of claim 3, wherein said storage con- ?o 
trol means Is operable to generate read address 
signals corresponding to the coded subtitles that 
are to be read from the storage control means in an 
order as indicated by the respective pointer data of 
each said data node in said address list. ?5 

The apparatus of claim 3, wherein said storage con- 
trol means includes means for determining, for each 
data node stored in the address list in an order as 
indicated by the respective pointer data of each said 20 
data node, whether a respective coded subtitle sig- 
nal stored In said storage means is to be output as 
a function of a system clock time and the respective 
display time data included in the respective data 
node; and for generating read address signals cor- -^5 
responding only to the respective coded subtitle sig- 
nal that has been determined to be output. 

The apparatus of claim 1 , wherein said storage con- 
trol means is operable to generate appropriate write 30 
address signals such that successively received 
and coded subtitle signals representing respective 
subtitles are stored in successive locations in said 
storage means, said storage control means being 
further operable to generate appropriate read ad- 55 
dress signals such that selected coded subtitle sig- 
nals in accordance with their respective display time 
data are read from said storage means; and said 
storage control means being further operable to re- 
move from said storage means a coded subtitle sig- ^0 
nal having respective display time data represent- 
ing an end time that is earlier than a current time 
only If there is no coded subtitle signals preceding 
said respective coded subtitle signal in said storage 
means. ^5 

The apparatus of claim 1 , wherein the storage con- 
trol means generates said read address signal and 
said write address signal such that said storage 
means operates as a first-in-flrst-out memory. 

Apparatus for decoding a coded subtitle signal, 
comprising: 

means for receiving a coded subtitle signal rep- 55 
resenting a subtitle to be superimposed on a 
video image, said coded subtitle signal includ- 
ing display time data representing a time at 



which said subtitle is to be superimposed and 
display position data representing a location in 
said video image at which said subtitle is to be 
superimposed; 

storage means for temporarily storing the cod- 
ed subtitle signal in accordance with a write ad- 
dress signal and for reading out the stored cod- 
ed subtitle signal in accordance with a read ad- 
dress signal; 

storage control means for generating an ad- 
dress list from said display time data and said 
display position data and for generating said 
read address signal and said write address sig- 
nal in accordance with the generated address 
list; and 

decoding means for decoding the read out cod- 
ed subtitle signal to produce a decoded subtitle 
signal. 

9. The apparatus of claim 8, wherein said storage con- 
trol means is operable to add a data node to said 
address list each time a coded subtitle signal rep- 
resenting a respective subtitle is received, said data 
node Including data corresponding to said display 
time data and said display position data included In 
said coded subtitle signal, said data node further In- 
cluding memory location data representing a loca- 
tion in said storage means at which said coded sub- 
title signal is stored. 

10. The apparatus of claim 9, wherein each data node 
in said address list further includes respective point- 
er data identifying another data node in said ad- 
dress list corresponding to a subtitle to be superim- 
posed positionally after the subtitle corresponding 
to the respective data node. 

11. The apparatus of claim 10, wherein said storage 
control means is operable to generate read address 
signals corresponding to those subtitles that are to 
be decoded and output for subsequent superimpo- 
sition on a video image in an order as indicated by 
the respective pointer data of each said data node 
in said address list. 

12. The apparatus of claim 10, wherein said storage 
control means Includes means for determining, for 
each data node stored In the address list In an order 
as indicated by the respective pointer data of each 
said data node, whether a respective subtitle signal 
stored in said storage means is to be output as a 
function of a system clock time and the respective 
display time data Included in the respective data 
node; and for generating read address signals cor- 
responding only to the respective subtitle signal that 
has been determined to be output. 

1 3. The apparatus of claim 8, wherein said storage con- 
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trol means is operable to generate appropriate write 
address signals such that successively received 
coded subtitle signals representing respective sub- 
titles are stored in successive locations in said stor- 
age means, said storage control means being fur- s 
ther operable to generate appropriate read address 
signals such that selected coded subtitle signals in 
accordance with their respective display time data 
are read from said storage means; and said storage 
control means being further operable to remove 
from said storage means a coded subtitle signal 
having respective display time data representing an 
end time that is earlier than a current time only if 
there is no coded subtitle signals preceding said re- 
spective coded subtitle signal in said storage ^5 
means. 

14. The apparatus of claim 8, wherein the storage con- 
trol means generates said read address signal and 
said write address signal such that said storage 20 
means operates as a first-in-first-out memory. 

15. Method of coding a subtitle signal, comprising the 
steps of: 

25 

'-i <- 

receiving a subtitle signal representing a subti- 
tle to be superimposed on a video image, the 
subtitle signal including display time data rep- 
resenting a time at which the subtitle is to be 
superimposed and display position data repre- 30 
senting a location in the video image at which 
the subtitle is to be superimposed; 
encoding the received subtitle signal to pro- 
duce a coded subtitle signal; 

generating an address list from the display time 35 
data and the display position data; 
generating a write address signal; 
generating a read address signal in accordance 
with the generated address list; 
storing the coded subtitle signal in a memory in 40 
accordance with the write address signal; 
reading the stored coded subtitle signal from 
the memory In accordance with the read ad- 
dress signal; and 

supplying as an output signal the coded subtitle ^5 
signal read from the memory. 

1 6. The method of claim 1 5, further comprising the step 
of adding a data node to the address list each time 

a subtitle signal representing a respective subtitle 50 
is received, each said data node including data cor- 
responding to the display time data and the display 
position data included in the respective subtitle sig- 
nal, each said data node further including memory 
location data representing a location in the memory 55 
at which the respective coded subtitle signal is 
stored. 



17. The method of claim 16, wherein each said data 
node in the address list further includes respective 
pointer data identifying another one of said data 
nodes in the address list corresponding to a subtitle 
to be superimposed positionally after the subtitle 
corresponding to the respective data node. 

18. The method of claim 17, wherein said step of gen- 
erating a read address signal is carried out by gen- 
erating a read address signal corresponding each 
coded subtitle that is to be read from the memory in 
an order as indicated by the respective pointer data 
of each said data node in the address list. 

19. The method of claim 17, wherein said step of gen- 
erating a read address signal is carried out by de- 
termining, for each data node stored in the address 
list in an order as indicated by the respective pointer 
data of each said data node, whether a respective 
coded subtitle signal stored in the memory is to be 
output as a function of a system clock time and the 
respective display time data included in the respec- 
tive data node and generating a read address signal 
corresponding only to each respective coded sub- 
title signal that has been determined to be output. 

20. The method of claim 15, wherein said step of gen- 
erating a write address signal is carried out by gen- 
erating appropriate write address signals such that 
successively received and coded subtitle signals 
representing respective subtitles are stored in suc- 
cessive locations in the memory; and said step of 
generating a read address signal is carried out by 
generating appropriate read address signals such 
that selected coded subtitle signals in accordance 
with their respective display time data are read from 
the memory; said method further comprising the 
step of removing from the memory a stored coded 
subtitle signal having respective display time data 
representing an end time that is earlier than a cur- 
rent time only if there is no coded subtitle signals 
preceding the respective coded subtitle signal in the 
memory. 

21. Method of decoding a coded subtitle signal, com- 
prising the steps of: 

receiving a coded subtitle signal representing 
a subtitle to be superimposed on a video image, 
the coded subtitle signal including display time 
data representing a time at which the subtitle is 
to be superimposed and display position data 
representing a location in the video image at 
which the subtitle is to be superimposed; 
generating an address list from the display time 
data and the display position data; 
generating a write address signal; 
generating a read address signal in accordance 
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with the generated address list; 
storing the coded subtitle signal in a memory in 
accordance with the write address signal; 
reading the stored coded subtitle signal from 
the memory in accordance with the read ad- 5 
dress signal; and 

decoding the read out coded subtitle signal to 
produce a decoded subtitle signal. 

22. Themethodof claim 21, further comprising the step io 
of adding a data node to the address list each time 

a coded subtitle signal representing a respective 
subtitle is received, each said data node including 
data corresponding to the display time data and the 
display position data included in the respective cod- ?5 
ed subtitle signal, said data node further including 
memory location data representing a location in the 
memory at which the respective coded subtitle sig- 
nal is stored. 

20 

23. The method of claim 22, wherein each said data 
node in the address list further includes respective 
pointer data identifying another one of said data 
nodes in the address list corresponding to a subtitle 

to be superimposed positionally after the subtitle 25 
corresponding to the respective data node. 

24. The method of claim 23, wherein said step of gen- 
erating a read address signal is carried cut by gen- 
erating a read address signal corresponding to ^o 
each coded subtitle that is to be decoded and output 

for subsequent superimposition on a video image 
in an order as indicated by the respective pointer 
data of each said data node in the address list. 

35 

25. The method of claim 23, wherein said step of gen- 
erating a read address signal is carried out by de- 
termining, for each data node stored in the address 
list in an order as indicated by the respective pointer 
data of each said data node, whether a respective 40 
subtitle signal stored in the memory is to be output 

as a function of a system clock time and the respec- 
tive display time data included in the respective data 
node and generating a read address signal corre- 
sponding only to each respective subtitle signal that 45 
has been determined to be output. 

26. The method of claim 21 , wherein said step of gen- 
erating a write address signal is carried out by gen- 
erating appropriate write address signals such that so 
successively received coded subtitle signals repre- 
senting respective subtitles are stored in succes- 
sive locations in the memory; and said step of gen- 
erating a read address signal is carried out by gen- 
erating appropriate read address signals such that 55 
selected coded subtitle signals in accordance with 
their respective display time data are read from the 
memory; said method further comprising the step 
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of removing from the memory a coded subtitle sig- 
nal having respective display time data represent- 
ing an end time that is earlier than a current time 
only if there is no coded subtitle signals preceding 
the respective coded subtitle signal in the memory. 
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